For dialogue applications that require very long conversations, summarize or filter previous dialogue
https://platform.openai.com/docs/guides/prompt-engineering/tactic-for-dialogue-applications-that-require-very-long-conversations-summarize-or-filter-previous-dialogue
コンテキストウィンドウの長さは無限ではない
There are various workarounds to this problem, one of which is to summarize previous turns in the conversation.
Once the size of the input reaches a predetermined threshold length, (略 サマると言ってそう)
Alternatively, prior conversation could be summarized asynchronously in the background throughout the entire conversation.
An alternative solution is to dynamically select previous parts of the conversation that are most relevant to the current query.
👉Use embeddings-based search to implement efficient knowledge retrieval